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Embedding a watermark in an infottnation signal. 



FIELD OF THE INVENTION 

The invention relates to amethod and an arrangement for embedding a 
watetnEiailc in an information signal, in particular an audio signal. The invention also relates 
to a method and acrangement for detecting a watermark in such an infomiadon signal, 

5 

BACKGROUND OF THE INVENTION 

In recent years tiiere has been a clear trend toward digitization of audio 
signals. Digital audio has many advantages over analog audio, such as easy access, efficient 
storage and transmission and the ability to make perfect digital copies. However, the ability 

10 to make perfect digital copies is considered as anuyor threat by record conq>anies as 
fear animcontroUable inarease in the spread of iltegal copies. The emergence of CD 
recorders and MP3 sit^ on the Internet does not heip in lessening that fear. 

Digital watermarking is an emerging technology that can be used ftr 
ownearship verificadon, broadcast-^monitoring and copy and playback controL A watermark is 

15 an imperceptible label which is embedded in ttie information signal by slightly modifying the 
signal .samples. The wntCTmaridng scheme should be designed in such a way tiiat it still 
reliably be detected after signal processing operations. In the field of audio, examples of such 
processing operations are compression^ cropping, D/A and A/D conversion, equalization, 
temporal scaling, groi^ delay distortions^ filtering, and removal or insertion of samples. 

20 Though many schemes on watermarking of still inaages and video have been 

published, thero is relativdy Utfle literature on audio watexmarking. Most of the techniques 
which have been published resemble image watCTmarking techniques. Image watermaddng 
techniques often hide a noisy watermark pattern in the pixel doxxiain, ^^^di corres^ 
the time domain for audio signals. Various aspects of such watermark embedding and 

25 detection methods are disclosed in Applicant's International Patent Applications 
WO-A-99/45705, WO-A-99/45706, and WO-A-99/45707. Another known audio 
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wttennarking schctae exploits echo-hiding. This technique entails embedding multiple and 
imperceptible echoes of the cover signal with specific delays. 

OBJECT AND SUMMARY OF THE IhTVEh^ 

It is an obj ect of the invention to provide a method of embedding a watermark 
5 in an infomurtion signal (particularly but not exclusively an audio signal), which is robust 
against tile above mentioned processing operations, and v*ich allows an embedded 
watermark to bo detected in a suspect signal withom requixi^ 
available. 

To this end, the invention provides amethod of embedding a watermark in an 
10 information signal, comprising the steps of: 

- generatiiig a series of watermark saniplesrepreseritiiigtiiewaterxnarlq 

* dividing the information signal in frames of a giv«i length; 

- Fourier transforming the frames into series of coefficients; 

- modifying the magnitudes of said coefficients as function of the watermark samples, 
1 S while leaving the phase of the coefiicients substantially unchanged; and 

- inverse transfonning the series of modified coefficients into modified signal frames. 

The invention esq^lolts the insight that liie human auditory system is 
insensitive to absolute phase, and tiiat audio signal modifications by group-delay distortior^ 
have little or no inq>act on the perceived quality. This is contrary to image and video content 
20 for which phase plays a much larger perceptual role. The watermarking scheme based on 
modifying absolute values of Fourier coefficients is also inherently invariant to delays. The 
relative position of tiie ftamM aksng flie time axis is therefore not relevant As a consequence, 
the division of the suspect signal into firames at the receiver end does tiot necessarily have to 
correspond to the divi^on of the origuial signal at the transmitter end. There is no need for 

25 synchronization. 

In an advantageous embodiment, the modifying step includes multiplicatively 
adding each watennaric sample to tiie corr^onding Fourier coefficient The expression 
"multq)licatively adding" herein means multiplying the coefficients with a scalar 1+a (where 
|a|«l in practice). This operation does not affect tiie phase of a coefficient and is easy to 
30 implement in practical systems. 

A significant advantage of the watermarking scheme is tisat it allows 
embedding multi-bit payload data in a simple yet efBsctive and easy-to*detect manner. To this 
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* end, an ^bodiment of llie method comprises tiie stqps of Qrclically shifting the series of 
watemuuck samples by an amoimt represeixting the payload data, and modifying tiie 
magnitudes of the coefScients as function of the shifted watemiaik samples. 

BRIEF DESCRIPTION OF THE DRAWINGS 
5 Figs. 1 and 2 show schematic diagrams of arrangements for embedding a 

wat^mark in accordance with the invention. 

Fig» 3 shows a schematic diagram of an arrangement for detecting a watermark 
iix an information signal. 

Fig. 4 shows a schematic diagram of an arrangement for embedding a multi-bit 
1 0 payload in an information signal. 

Fig. 5 shows a schematic diagram of an arrangement for detecting a multt-'bit 
payload in an mformalion signal. 

Fig. 6 shows a diagram to illustiate the operation of the a rrangement which is 
sho^ in Fig. S. 

15 

DESCRIPTION OF PREFERRED EMBODIMENTS 

Fig. 1 shows a schematic diagram of an arrangement for embedding a 
watermark in accordance with the invention. The embedding process is p^onned on a £rame 
by frame basis. To this end, the arrangement comprises a division circuit 10 vfbidh divides 
the incoming digital audio signal x(n) into frames of 2048 audio signal san^les. The frame 
length is a tradeoff between detection porfonnance and audibility. A large frame length is 
desired for detection robustness, A short frame length is desired to better adapt ^ 
embedding to local properties of tiie audio signal. 

The frames of 2048 audio samples are i^Ued to a Fast Fourier Transform 
circuit 11. Each firame is hereby transformed into a series of 2048 Fourier coef&dents X(k). 
As is generally known in the field of matibematics, the Fourier coefScients occur in pairs. 
Each pair comprises a complex number representing a positive frequency^ and its conjugate 
20 representing a negative frequency. Further operatians are therefore applied to 1024 Fourier 
coefficients. In view hereof, the index k will hereinafier also be assunied to 
[0..1Q23]. A magnitude and phase calculation ciicuit 12 determines the mag"^*^^^^ or absolute 
value |XCk)| and the phase <p(k) of the coefiicients. 
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Theaiianganentfiutiwrcompriseaamemory 13inv^ . 
W is Btoied in the fiam of 1024 watetmatk samples w(k). The memory is preferably a read- 
only niemory wMch can net be intenogate(i The waten^^ 

sanies w(k) are drawn fiom a normal distributian with mean 0 and standard deviation 1 . 
5 The watermark W is multipUed (14) witti a global scaling fector s, which determines the 
tradeoff between robustness and audibility of tiie watermark. The scaled watermark samples 
sw(k) are subsequently added (IS) to the corresponding coefficient magnitude pC(k)| so as to 
generate modified magnitudes |Y(k)l. As Fig. 1 shows, this process of modification leaves the 
phase (p(k) unafEected. 

10 The modified co6flScients|Y(Jc)|ai»d original phases 9(k) are combined by a 

reconstruction circuit 16 so as to represent the modified SCTies of Fourier coefficients YOO by 
con^lex numbers and their respective conjugates. One can easily verify Uxat the power of tixe 
modified series of coefficients Y(k) will on av^ge be scaled by a fector 1 +s* by the 
^y^Ain^ process. An optional power equalization circuit 17 in due arrangement re-scales 

15 the watermarked Fourier coefficients Y(k) to such an extent that the power of the original 

coefficients XOO in eadb. series is restored. This optional operadon prevents diat watermaiked 
content can be distingmahed fiom the original by a power diffeience. An Inverse Fast Fourier 
Transfimn circuit 18, which tcansfoxms ^e modified soies of coefficients bade to series of 
2048 signal samples y(n) in the original time domain, completes the embedding process. 

20 Fig. 2 shows a more practical embodimmtoftheembedder, which is easi» to 

implement The same reference numerals are used to denote die same funcdons or circuits as 
in Fig. 1 . The watermarked Fourier coeffidents Y(k) are now obtained by multiplyirig (20) 
sw(k) with XOc), and adding (21) the result to X(k), This opawdon, which is referred to as 
muldpHcative addition, yields: 

25 Y(k) = X(k)Cl+sw(k)] 

Note that the operation does not affect the phase of X(k), because [l+8w(k)] is a real number. 

In a fintixer embodiment of die arrangement, the watetmazk samples wOc) are 

not only scaled by the global scaling factor s. Instead diereof (or in addition thereto), the 
samples are scaled by afector A<k), die value of which depends on the index k in accordance 
30 with a ^ven model of the human audidve system. SvxHx an arrangement (not shown) embeds 
die watennaric in accordance with: 

Y(k) = X(k)D + 8X(k) w(k)] 
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Fig. 3 shows a schematic diagram of an anangemeat for detecting a ^watermark 
in a suspect infomiadon signal. To boost tiie detection peifomiance, the possibly 
watennarked audio signal y(n) is first decotreloted by an optional decoxrelation filter 30. An 
exaxx4)le of such afilter is the 3 taps FIR filter F: 
5 F^[-l 2 -1] 

The (filtered) signal y(n) is c^Ued to a division circuit 31 yAddi divides tiie incoming digital 
audio signal x(n) into firames of 2048 audio signal sanqples. The length of the firames is 1b0 
saxne as in the embedder. Note, however, that the i>osition of the frames may be dif&rent. 
Thexe is no need for synduronization between the division circuit 3 1 and the corrosponding 
10 division circuit 10 of the embedder. Each firame of signal samples is subjected to an FFT by 
Past Fourier Transfom circuit 32. As already mentioned above, furttm operations are 
applied to 1024 Fourier coefBoients Y(k) Oc»0,.1023) because the Fourier coefBcients occur 
in coi^ugate pairs. A magnitudft calculation circuit 33 detemiinea the absolute value | Y(k)i of 
the coefficients. 

15 The anrangement fiirttier in c l u des a correlation circuit 34. The corcelatlon 

circuit calculates for each signal firame the correlation Cbe^ |Y(k)| and 

the corresponding samples w^c) of the watemiaric pattern W to be detected. In mathematical 
notation: 

20 The waiemiaxk satnples w(k) are retrieved from a memory 35, preferably a read-only 
monory which cannot be interrogated. An (optional) accumulator 36 accumulates the 
correlation for anumber of successive frames to improve Uie detection reliability. A 
comparator 37 con^>ares the accumulated correlation £C with a given Uneshold. If the 
correlation is larger &an the tinmhold:, an output signal is generated to indicate tiiat the 

2S suspect audio signal is indeed watermarked with the secret watermark W. 

Fig. 4 shows a schematic diagram of an arrangement for embedding a multi-bit 
payload in an ixiforxnafion signal in accordance v^th a fu^^ 

same reference numerals are used to denote the same fimctions or circuits as in Fig. 2. The 
arrangement dififers from the embedder, wliich is shown in Fig. 2, by a input fi>r receiving a 
30 multi-bit payload P, a mapping circuit 40, and a cyclic shift circuit 41. The mapping circuit • 
40 mi^s the multi*bit payload P onto a shift vector v. In the present example, the payload is a 
10-bit code and the shift vector is a number in the range [0..1023]. The cyclic shift circuit 41 
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is connected between the watetmark memory 13 and the muItipUer 14. It cycUcaUy shifts the . 
series of watermiuck samples w(k) by v. The tufted series of watetmack saxtqples is denoted 
WCk) in the Figure. 

Pig. 5 shows a schematic diagram of the coiiesponding payload decoder. The 

S same reference numerals are used to denote the same fiucdons or circuits as 

arrangement differs from the embedder, which is shovra in Fig. 3, in that a correlation circuit 
50 calculates the correlation Cv for each possible shift vector v. The correlation circmt thus 
generates a series C of correlatiott values Co..Cun3. In a preferred embodiment of the 
payload detector, the correlation is actually done in. the Fourier domain of the signal |Y| using 

10 Symmetrical Phase Only Matched Filtering (SPOMF). Mote particularly, the peak pattern C 
is obtaiiked by calculating: 

C = IFFT(td»aseCtaly(FFT<|Yl)phaseCtaly^^ 
where phaseOnly(x>'x/|xl for and pha8eC^y(0>=l. A more detailed desoription of 
SPOMF can be found in Applicant's International Patent Application WO-A-99/4S707. 

Xs A signal that has beoi watermarked with die watermark Wbeiiig shifted over 

V samples (as conq>ared with the \in«<hlftfd watermark W being appUed to correlator 50) 
exhibits a sharp peak. In view hereof the series of correlation values Co..Cim is also refeired 
toasapeakpattem. Fig. 6 shows a practical exanople of such a peak pattern for v=S12. In 
this example, ^ vertical axis denotes the detection reliability in stendard deviations. A 

20 dashed line for the standard deviation value 5 represents a threshold for a correlation value to 
beapeak. A payload decoder 52 retrieves the shift vector v from said peak pattern and 
decodes the payload P. An (optional) accumulator SI which accumulates the peak patterns of 
a number of frames inqvoves the robustness of payload retrievaL The payload capacity can 
furdier be increased by embedding a plurality of watermark patterns with different shifts. 

25 It should be noted that encoding a payload in the shift of a walettnaik pattern 

is known per se from Intetnational Patent Application WO-A-99/45705, where the watermark 
is embedded in die jrixel domain of an image signal. However, in the prior art method d>e 
payload is encoded into the relative shift of the watermark widi respect to a reference 
watennark (i.e. a difierent watemoad: pattern or the same pattern with a different sign). The 

30 present method does not req\jite such a refeience watermark to be embedded because ihe 

embedding scheme is inherently robust against shifts. 

Disclosed is a method and an arrangement for embeddfaig a watermark in an 
information signal, inpartlcular an audio signal. The method is based on modification of the 
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Tnagnitode (not the phase) of Foiuier coefficiems and does not require the original s^nal for 
detection. The embedder divides (10) tiie signal in ftames of a given lengthy and subjects 
each franoe to a Fast Fourier Tranafonn (11). The Fourier coefScienta X(k) are modified 
(20,21) as fianction of a predetermined secret watermark W. A payload (P) is encoded in the 
5 embedded watermark by cyclically shifting (41) the ^watermark W by axmmber (v) of 
sanqiles reprMenting said x>aylodd. 
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CLAIMS: 



I. 



A method of embedding a watomazk in an infoimation signal, comprising the 



steps of: 

- generaiing a series of watennadc samples representing the watermark; 



_ dividing tiieinfonnation signal in frames of a given length; 
5 - Fourier transfonning the j&ames into series of coefficients; 

- modifying the magnitudes of said coefficients as function of the watermark samples, 
while leaving the phase of tiie coefBcieaats substantially unchanged; and 

- inverse transforming the socies of modified coefiGcients into modified signal frames. 

10 2. A metihod as claimed in claim 1, wherein said modi^nngstq) includes 

multiplicatively adding each watermaric senile to the conresponding coefficient 

3. A method as claimed in claim 1, fur^^ including tiie step of wdghtingthe 
watennaxk samples using respective weighting fiwtorB, said weighting fiactors being selected 

15 in accordance wi& a given human acoustic model. 

4. A meOiod as claimed in any one of daims l-3»fiiraier comprising the step of 
scaUng the series of modified coefficients to such an extant tiiait the power of said modified 
coefficients is substantially equal to the power of the corresponding original coefficients. 

20 

5. A metfaod as claimed in claim 1, further comprising the steps of: 

- receivii^ payload daita; 

- cycHcaUyshiftiug the series ofwatermark samples by an amount Tq)resenting said 



25 



payload data; 

wherein the step of modifying ihe magoitudes of the coefficients conqirises modifying said 
n ^ ^ i tt,A»« as function of tfu shifted watermark samples. 
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"6. Ametbodof detecting a watemuurk in an oompiisinglfae 

steps of; 

- generating a watermark as a series of watennark samples; 

* dividing the information signal samples in frames of a given length; 
5 — Fourier transforming the frames into series of coefficients; 

- calculating the magnitude of each coef&cietr^ 

determinii^ the correlation between a series of coefficient magnitudes and the series of 
watemiaiic san^ies; 

- generadns an indication signal if said correlation exceeds apredetemiined threshold. 

10 

7. A method as claimed in claim 6, furd&er comprising the step of accumulating 
said correlation &r a number of frames prior to the step of generating the indication signal. 

8. Amethod as claimed in claim 6, wherein said step of determinmg the 
1 S correlation comprises determining the correlation between the series of coefficient 

magnitudes and aplutality of series of watermark nmples, each series of watemark saaq>les 
being a cyclically shifted version of a given series of watermark samples by an amount 
representing payioad data; and further comprisii&g the steps of: 

- determining the series for ^\^ch said correlation exceeds a given threshold; and 
20 decoding the corresponding cyclic shift into payioad data. 

9. Anaxraiigememfor of embeddingawatemiarkinaninforination si 
comprising: 

- means for generating a series of watermaric samples representii^g the watermark; 
25 - meaiis for dividing the inforrnation signal in frames of a given length; 

* means for Fourier transforming the frames into series of coefficients; 

- means for modi^ong the magnitudes of said coefficients as function of the watennark 
samples, while leaving the phase of the coefficioits substantially unchanged; and 

* means for inverse transforming the series of modified coefficients into modified signal 
30 frames. 



10. An arrangement for detecting a watermark in an information signal, 

comprising: 
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- means for generating a watennark as a sen 

- means fcr dividing the infoniaation signal samples in frames of a given length; 

- m^'^ffi? for Fourier transfbxming the frames into series of coefficients; 

- means for calwl^^^g the magnitude of each coefficient; 
5 - means for determmingfliewinelationbet^^ 

series of watermark samples; 

- means for generatiiig an indication signal if said correlation exceeds a predetermined 
Ibreshold. 



IQ An i nf^^^^ ^ aignal having an embedded watermarks characterized in tiaat 

the information signal has been divided in frames of a given length, the magnitudes of Ihe 
Fourier coefficients of the series have been modified as function of a watennaik while 
leaving the phase of the coefficients substantially unchanged, and the series of modified 
coefficients have been inverse transformed into modified signal frames. 

15 

12. A storage medium having recorded thereon an information signal as claimed 

in claim 11. 
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ABSTRACT: 



Disclosed is a mediod and an axrangement for embedding a watexmaik in an 
information signal, in particular an audio signal. The mediDd is based on modification of the 
Tnagnitode (not the phase) of Fourier coefficients and does not require the original signal for 
detection. The embedda divides (10) the signal in fiames of a given laigth« and subjects 
each firame to a Fast Fourier Transform (1 1). The Fourier coefiBcients X(k) are modified 
(20.21) as function of apredetemuned secret watetmark W. Apayload (P) is encoded in the 
embedded watemiark by cyclically shifting (4 1 ) the watermark W by a number (v) of 
samples representing said payload. 



10 Fig. 4. 
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